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telephone network is disclosed. The data network, which may include an internet or intranet, is connectible to at least one information 
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user through the data network. Furthermore, the electronic communications manager can send and receive internet protocol to and from 
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ELECTRONIC COMMUNICATIONS MANAGER 
Technical Field 

This invention relates generally to user/network interface systems, and 
in particular, to the utilization of an integrated, electronic communications 
manager referred to as an Advanced Virtual Assistant ("AVA") for interfacing a 
5 user with both telephony and data networks. 
Background of the Invention 

The remote accessability of people and information is continually 
increasing. A person now has at his disposal many different communication 
devices, such as a telephone, cellular telephone, pager, facsimile, and e-mail. 

10 Likewise, the availability of general information such as financial data, 

business information, weather reports, and/or newspapers, as well as personal 
information such as a one's calendar or schedule, has grown tremendously. 

An advantage to the increasing diversity of communication devices is 
that the person now has the possibility of greater mobility as well as different 

15 mediums for receiving information. However, the increased number of 

communication devices, coupled with the increased availability of information, 
makes providing a desired portion of information to one of the communication 
devices more and more difficult. In fact, often a full-time personal assistant is 
required to successfully connect to the desired information to the 

20 communication device. Unfortunately, not everyone can afford a personal 
assistant, nor are most personal assistants available around the clock. 

In addition to the increasing diversity of communication devices, there is 
an increasing diversity of communication paths. Traditionally, for two people 
to talk on their telephones, they had to use a long distance provider in the 

25 public switched telephone network. However, there are now alternative 

communication paths that have specific benefits that make them desirable 
alternatives to the long distance provider. For example, two people may talk to 
each other over the internet. Although the "grade" of service is not as reliable 
as from the long distance providers, the cost is very low. It is difficult, 

30 however, to switch ones telephone from one communication path to another, 
such that most people simply vise the long distance provider, even though at 
times, the higher grade of service provided is nonessential. 
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Therefore, what is needed is an electronic communications manager that 
can provide all the benefits of a personal assistant without the extra cost or 
working hour limitations. 

In addition, what is needed is an electronic communications manager 
5 that provides a selectable grade of communication service by providing easy 
access to multiple communication paths. 
Summary of the Invention 

In response to such difficulties, a technical advance is achieved by 
providing an integrated, electronic communications manager, hereinafter 

10 referred to as an Advanced Virtual Assistant CAVA"), that provides an 

intelligent interface between a user and a data network and/or a telephone 
network. The user may communicate with the AVA using one or more types of 
communication devices. The data network, which may include an internet or 
intranet, one or more databases, and applications such as a universal mailbox, 

15 schedules, and/or calendars, is connective to at least one information provider, 
such as, for example, an investment financial data tracking service. 

The AVA can receive and interpret voice, such as those received from the 
user using a telephone, as well as data, such as those received from the user 
using a computer. Likewise, the AVA can provide voice, such as would be 

20 necessary for interacting with the user via a telephone, and can provide data, 
such as would be necessary for interacting with the user via a pager. 
Furthermore, the AVA can send internet protocol to and receive internet 
protocol from an information provider. As a result, the voice spoken by the 
user and directed to the information provider are translated by the AVA into 

25 data for transmission to the information provider. In addition, the information 
provider can make responsive data available in reply to the user's voice, which 
data is appropriately translated by the AVA for communication to the user. 

In another embodiment, the AVA also enables the user to select whether 
to connect to a second person via a telephone network or a data network. In 

30 this case, both the telephone network and the data network are connectible to 
the second person. Since the telephone network and the data network provide 
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different "grades" of communication service, the AVA thus enables the user to 
select between the different grades. 

A technical advantage achieved with the invention is that the AVA can 
provide all the benefits of a personal assistant without the extra cost or 
5 working hour limitations. 

Another technical advantage achieved with the invention is that a 
significant reduction in communications cost is achieved through use of a 
selectable grade of communication service, including voice-over internet. 
Brief Description of the Drawings 

10 Pig. 1 illustrates a communication network employing one embodiment of 

an AVA of the present invention. 
Description of the Preferred Embodiment 

Referring to Fig. 1, the reference numeral 10 designates a 
communication network including both a public switched telephone network 

15 ("PSTN") 11a and a data network ("I-NET") lib. The I-NET lib represents 
one or more intranets and/or internets. Connected to the PSTN 11a are two 
switches 12, 14. For the sake of example, each of the switches 12, 14, is shown 
in Fig. 1 as comprising a single network switch. It is understood, however, that 
the switches 12, 14, may comprise any type of switch, such as a private branch 

20 exchange (PBX) switch or a long distance carrier switch. Therefore, any type of 
line/trunk determination illustrated or described herein is for the sake of 
example, and is not intended to limit the invention. 

The switch 12 enables a first user ("USER1") to interface with the PSTN 
11a and I-NET lib using one or more of a variety of communication devices, 

25 including, for example, a cellular phone 16, a telephone 18, a pager 20, a 

computer or information appliance (generically referred to as a "PC") 22, and a 
facsimile machine 24. In addition, the telephone 18 is further connected to a 
voice-mail system (not shown). It is understood that each of the communication 
devices may interface with the switch 12 with many different communication 

30 links, such as a wireless/cellular link for the cellular phone 16 and the pager 
20, a telephone line for the telephone 18 and the facsimile machine 24, and a 
data link for the personal computer 22. Therefore, accommodation of many 
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different types of communication devices and corresponding communication 
links is anticipated. 

Similarly, switch 14 enables a second user ("USER2") to interface with 
the PSTN 11a and I-NET lib using a variety of communication devices 
including, for example, a telephone 26 and a PC 28. The PC 28 is connected to 
a voice-over internet protocol device ("V/IP") 30 for transmitting data packets 
between the I-NET lib and the PC 28. 

Connected to the switch 12 is an Advanced Virtual Assistant CAVA") 40, 
which serves as an integrated, electronic communications manager between 
USER1 and the I-NET lib as described in greater detail below. In the 
preferred embodiment, the AVA 40 is an adjunct to the switch 12 and therefore 
also includes several T-l trunk interface cards (not shown). However, it is 
understood that the AVA 40 may be incorporated into the switch 12 itself or 
may be associated with another switch (also not shown). The AVA 40 includes 
a V/IP 42, an automatic speech recognition device ("ASR") 44, a text-to-speech 
device ("TTS") 46, a controller 48 and a storage device 50. 

Also connected to the I-NET lib are three information providers 60, 62, 
64, and a V/IP 66. Although each of the information providers 60, 62, 64, may 
be one of any number of different types of information providers, for the sake of 
20 example it will be assumed that the provider 60 is a financial information 

provider, the provider 62 is a concierge information provider, and the provider 
64 is a local area network (LAN) information provider that is also connected to 
the PC 22. The V/IP 66 connects the I-NET lib to the switch 14. It should be 
recognized that the V/IP 66 and the V/IP 30 overlap somewhat in their 
25 functionality, and therefore either or both may be provided in the 
communications system 10. 

The method in which the AVA 40 communicates with USER1 depends on 
the communication device 16, 18, 20, 22, and/or 24 being used. For example, 
USER1, using the telephone 18, can provide voice, which the AVA 40 interprets 
using the ASR 44 and provides to the controller 48. Likewise, the AVA 40 can 
signal USER1 with voice prompts by using the TTS 46 or pre-recorded voice 
clips, with pager messages by using an external paging system (not shown), e- 



30 
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mail, voice mail, video-mail, facsimiles, or other types of messages. In addition, 
the AVA 40 may communicate with USERl through a web page (also not 
shown) and may supply video clips to the PC 22. As a result, the AVA 40 
serves as a media cross-translator by interpreting information provided in one 
5 format (e.g., voice) to a totally different format (e.g., data). Furthermore, the 
AVA 40 can serve as a video interactive voice response unit. It is understood 
that descriptions of voice and data are merely exemplary of many types of 
formats including video, text, control codes, DTMF tones, serial bit streams, 
wireless signals, and other types of communications. 

10 USERl may interact with the I-NET lib, and hence the information 

providers 60, 62, 64, through the ASR 44 using, for example, speech 
recognition, or through the controller 48, for example, via USERl f s PC 22 
directly through the web page. The V/IP 42 also enables USERl and USER2 to 
verbally communicate via the I-NET lib. The AVA 40 thereby provides several 

15 benefits, two of which are media cross-translation between USERl and the 
information providers, and a selectable grade of service between USERl and 
USER2, both described in greater detail below. 
L Advanced Information Access 

The controller 48 maintains a profile for USERl in the storage device 50. 

20 The profile includes voice prints for use by the ASR 44 for voice identification 
and verification, account numbers for use with the various information 
providers, preferences such as airline seat preferences or favorite pizza 
restaurant, and speed dials, including grade of service selection. The profile 
also includes a schedule that describes the accessibility of USERl. The 

25 schedule may contain working hours in which USERl is accepting calls at 
work, home hours in which USERl is accepting calls at home and off-hours 
when calls should be directed to voice-mail. 

To better explain how the controller 48 uses the profile to interact with 
the information providers 60, 62, 64, the following scenarios are helpful. 

30 A. Financial Information Provider 60 

USERl, using the telephone 22, wants to be informed of certain financial 
information. The financial information provider 60 is a service, accessible 
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through the I-NET lib, that can report the financial information, as described 
in Table 1, below. 

Table 1: Access to Financial Services 



Action: 


USER1 dials the AVA 40 and hears ringing. 


Action: 


AVA 40 answers the ringing line and speaks to USER1 using a 
prerecorded voice clip. 


AVA 40: 


"Good morning and thank you for calling AVA, your Advanced 
Virtual Assistant for Financial Services. Please enter (or say) 
your social security number and state your name" 


USER1: 


"123-45-6789, David May" 


Action: 


AVA 40 verifies the account number and name, as interpreted by 
the ASR 44. Alternatively, AVA 40 may simply require USER1 
to state only his name, and then verify the account information 
through voice identification 1 verification procedures. AVA 40 
speaks to USER1 using the TTS 46 or voice clips. 


AVA 40: 


"Thank you David May. Would you like to make a trade, get 
information or update your preferences?" 


USER1: 


"Uh, I guess I want to update my preferences." 


ATT A i A 

AVA 40: 


"Which preference would you like to update?" 


USER1: 


"Change my notification preferences." 


ATT A A r\ 

AVA 40: 


Would you like to be notified when there is significant market 
movement in your portfolio?" 


T TCJT7»*P 1 . 
UolliI\±: 


Yes, 1 would. 


AVA 40: 


"Under what conditions would you like to be notified?" 


UorLiivl: 


When there is movement of 20%. 


AVA 40: 


"Over what period of time?" 


USER1: 


"Good question. Over a two day period." 


AVA 40: 


"How would you like to be notified?" 


USER1: 


"Notify me via my pager." 


AVA 40: 


"Would you also like to be notified of related news stories of 
companies in your portfolio." 
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USER1: 


"Yea sure. Thanks." 


AVA 40: 


"And how would you like for me to communicate these stories to 
you?" 


USER1: 


"Just send them to my fax machine." 


AVA 40: 


"Your home or your office fax machine." 


USER1: 


"Send it to my home fax machine." 


AVA 40: 


"I will notify you via your pager if there is movement greater 
than 20% in your portfolio over a two day period. I will also 
notify you via your home fax of any related news stories. Is this 
correct?" 


USER1: 


"That's it." 


AVA 40: 


"Dave, I see you haven't contributed to your IRA for 1996. 
Would you like someone to contact you?" 


USER1: 


'Tea, I guess so." 


AVA 40: 


"Thank you Dave. It was a pleasure to serve you. I am AVA. 
Your Advanced Virtual Assistant for Financial Services." 


Action: 


USER1 goes on-hook. 


Action: 


AVA 40, through the VHP 42, sends the acquired information to. 
the financial information provider 60. 


Action: 


When the financial information provider needs to provide 
information to USERl, it provides it to AVA 40. AVA 40 then 
transfers the information according to the above instructions. 



15 



USERl, using the telephone 22 wants to purchase an item. The 
Concierge Information Service 62 is a service, accessible through the I-NET 
lib, that can provide the requested item, as described in Tables 2 and 3, below. 

Table 2: Access to Concierge Services, part 1 





Action: 


USERl dials the AVA 40 and hears ringing. 


20 


Action: 


AVA 40 answers the ringing line and speaks to USERl using a 
prerecorded voice clip. 
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AVA 40: 


Good morning and thank you for calling AVA, your Advanced 
Virtual Assistant for Concierge Services. Please enter your 
social security number and state your name " 


USERl: 


"123-45-6789, Brian Thompson" 


Action: 


AVA 4 verifies the account number and name, as interpreted by 
the ASR 44. Alternatively, AVA 40 may simply require USERl to 
state only his name, and then determine and verify the account 
information through voice identification 1 verification procedures 


Action: 


AVA 40 speaks to USERl using the TTS 46. 


AVA 40: 


"Thank you Brian Thompson. How may I help you?" 


USER1: 


I m looking for a restaurant." 


AVA 40: 


Do you plan to go to the restaurant or would you like the food 
delivered?" 


USERl: 


"Delivered please." ™~ " 


AVA 40: 


"Very good. What type of food would you like delivered? Pizza, 
Chinese or something else?" 


TTQT7»r>i . 

UoHirCl: 


"Pizza please." 


AVA 40: 


"Would you like it delivered to your home or somewhere else?" 


USERl: 


"To my home please." 


AVA 40: | 


One moment while I connect you to your local Domino's Pizza." 


USERl: "™~ 


"Thank you." ' " " " 


Action: 


Alternative 1: AVA 40 calls Domino's Pizza. If this is the first 
time to call Domino's Pizza, AVA 40 may prompt USERl for 
certain information to determine the closest restaurant. 


Action: 


AVA 40 listens in on the call. USERl may bring AVA 40 into 
the call for information such as credit card number, etc. AVA 40 
waits for USERl to say "Goodbye". 


Pizza: 


Hello and thank you for calling Domino's Pizza. What type of 
item would you like to order? . . ." 


USERl: 


A large pepperom pizza. AVA, what is my VISA credit card 
number?" 
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AVA 40: 


"Brian Thompson's VISA card number is 1234 5678 90" 


USER1: 


'Thanks and goodbye." 


Action: 


AVA disconnects Domino's Pizza but stays on the line with 
USER1. End of Alternative 1. 


Action: 


Alternative 2, AVA 40 contacts the web site for Domino's Pizza 
and does the prompting itself 


AVA 40: 


"Hello and thank you for calling Domino's Pizza. What type of 
item would you like to order? ..." 


Action: 


AVA 40 contacts Domino's Pizza, either through a web page, e- 
mail, facsimile, or direct voice communication. AVA then 
updates USERl's profile. End of Alternative 2. 


AVA 40: 


"Thank you Mr. Thompson. It was a pleasure to serve you. I'm 
AVA. Your Advanced Virtual Assistant for Concierge Services." 


Action: 


USER1 goes on-hook. 


Table 3: Access to Concierge Services, part 2 


Action: 


USER1 dials the AVA 40 and hears ringing. 


Action: 


AVA 40 answers the ringing line and speaks to USERl using a 
prerecorded voice clip. 


AVA 40: 


"Good morning and thank you for calling AVA, your Advanced 
Virtual Assistant for Concierge Services." 


USER1: 


"AVA"? 


AVA 40: 


"I'm here!" 


USER1: 


"Please find me the best flight to Boston after 5PM on 
Wednesday and returning Friday after 3PM 


AVA 40: 


"Where would you like that flight information sent"? 


USER1: 


"Please send it to my pager" 


AVA 40: 


"Let's see - your request is to find the best flight to Boston after 
5PM on Wednesday and returning Friday after 3PM and you 
want that flight information sent to your pager. Is this correct? 


USER1: 


"Yes, perfect". 
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Action: 


AVA 40 sends an Information Query Data Packet Message sent 
to Airline Information Service Provider 62 for the best flight 
cost, Dallas to Boston, after 5PM CST, 2/19/97, return 2/21/97 
after 3 PM EST 


Action: 


3 minutes later, an Information Response Data Packet Message 
is received from the Airline Information Service Provider 62 
stating that "This information provided to you by ABC, Inc. - 
The best flight is XYZ546 leaving Dallas at 5:48 PM CST on 
Wednesday 2/19/97, return flight is XYZ710 leaving Boston at 
3:20 PM EST 2/ 21 197 and total flight cost is $567.32". 


Action: 

T A 


AVA 40 relays this message directly to the pager 20, with an 
added message - <( Please call AVA if you want this flight 
reservation placed for you" 



USER1, using the telephone 22, wants to access the PC 22. Although 
not shown, the LAN Information Service 64 is connected to the PC 22, as well 
as to USERl's e-mail, voice mail, and other services. Two examples are shown 
in Tables 4 and 5. 

Table 4: Access to PC 22 



Action: 


USER1 dials the AVA 40 and hears ringing. 


Action: 


AVA 40 answers the ringing line and speaks to USERl using the 
TTS 46. 


AVA 40: 


"Good afternoon. AVA here. Based on the number you're 
calling from, I'm assuming this is Larry. Is that right?" 


USER1: 


'Tea it sure is." 


Action: 


AVA 40 determines account information through the caller's 
automatic number identification (ANI). In addition, AVA 40 may 
verify the account information through voice identification/ 
verification procedures. 


AVA 40: 


"How may I help you?" 



10 
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USER1: 


"I need you to fax a copy of two Word Perfect documents to my 
hotel." 


AVA 40: 


"Which documents?" 


USER1: 


"c:/wp51/wpdocs/data.doc and c:/wp51/wpdocs/data2.doc." 


AVA 40: 


"My pleasure." 


Action: 


AVA 40 accesses the PC 22 and attempts to retrieve the requested 
documents. 


AVA 40: 


"I can not find c:/wp51/wpdocs/data.doc. Is that the correct 
name for the document?" 


USER1: 


"How about c:/wp51/wpdocs/datal.doc." 


Action: 


AVA 40 accesses the PC 22 and attempts to access the requested 
documents. 


AVA 40: 


"I have found both documents. I will fax them to your hotel 
within the next 15 minutes. Anything else?" 


USER1: 


"That's all " 


AVA 40: 


'Thank you Larry. As always, it's a delight to serve you. I'm 
AVA. Your Advanced Virtual Assistant for Messaging Services." 


Action: 


USER1 goes on-hook. 


Action: 


AVA 40 retrieves the two documents and faxes them to the correct 
machine. If an error occurs, AVA reports the error in USERVs 
profile as well as sends an e-mail to USER1 describing the error. 


Table 5: Access to Voice-mail/E-mail 


Action: 


USER1 dials the AVA 40 and hears ringing. 


Action: 


AVA 40 answers the ringing line and speaks to USER1 using the 
TTS46. 


AVA 40: 


"Good afternoon. AVA here. Based on the number you're 
calling from, I'm assuming this is Larry. Is that right?" 


USER1: 


"Yea it sure is." 


Action: 


AVA 40 determines account information through the caller's ANL 
In addition, AVA 40 may verify the account information through 
voice identification 1 verification procedures. 
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AVA 40: 


How may I help you?" 




USER1: 


1 Transfer all of my calls to my cellular phone." 




AVA 40: 


"For what period of time?" 




USER1: 


"Today only." 


5 


AVA 40: 


My pleasure. I will transfer your calls to your cellular phone 
for the balance of the day. Anything else?" 




USER1: 


"Yes. Send new e-mails to my fax machine." 




AVA 40: 


"Your home, business or other fax machine?" 




USER1: 


"My home fax machine." 




AVA 40: 


"I will send your new e-mails to your home fax machine as soon 
as possible. Anything else?" 


10 


USER1: 


"Yes. I want to send a voice-mail." (alternatively, e-mail, video- 
mail, etc.) 




AVA 40: i 


"I'm ready. Start recording." 




Action: 


AVA 40 begins to record all sound to the storage device 50. 




USER1: 

- 


"Guys, the presentation today went great! Thanks for your help 
and have a wonderful weekend. FINISHED." 




AVA 40: 


"To whom should I send the voice-mail?" 


15 


USER1: 


"Send it to my department distribution list." 




AVA 40: 


"Very good. I will send your voice-mail to your department 
distribution list immediately. Anything else?" 




USER1: 


"That's all." 




AVA 40: 


"Thank you Larry. As always, it's a delight to serve you. I'm 
AVA. Your Advanced Virtual Assistant for Messaging Services " 




Action: 


USER1 goes on-hook. 


20 


Action: 


AVA 40 updates USERl 's schedule on the storage device 50 and 
forwards the telephone 18 to the cellular phone 16. 




Action: 


AVA 40 retrieves USERl 's e-mail address and home fax number, 
logs-in to USERl's e-mail, and faxes the e-mails to the home fax 
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Action: 



AVA 40 retrieves the recorded voice-mails, logs-in to USERl l s 
voice mail system, and publishes the voice mail message to the 
appropriate recipients. 



The controller 48 for the AVA 40 also uses artificial intelligence 
programming to adapt its interface with USERl. Therefore, AVA 40 can learn 
from previous interactions with USERl. Considering the concierge information 
service example of Table 2, AVA 40 can store USERl's pizza preference in 
USERrs profile, therefore, the next time USERl uses the Concierge 
Information Service 62, the interaction may be as described below in Table 5. 
Table 6: Access to Concierge Services, part 3 



iit tlull. 


\j tDjifihi LLiais me j\v/\ *±\j ana nears ringing. 


Action: 


AVA 40 answers the ringing line and speaks to USERl using a 
pi hi tzcurLLtzti voice cup. 


AVA 40* 


vjoou morning ana tnanK you tor calling AVA, your Advanced 
Virtual Assistant for Concierge Services. Please enter your 
social security number and state your name." 


USERl: 


"123-45-6789 Brian Thomnson" 


Action: 


AVA 4 verifies the account number and name, as interpreted by 
the ASR 44. Alternatively, AVA 40 may simply require USERl to 
state only his name, and then determine and verify the account 
information through voice identification 1 verification procedures. 


Action: 


AVA 40 speaks to USERl using the TTS 46. 


AVA 40: 


"Thank you Brian Thompson. How may I help you?" 


USERl: 


"I want to order a pizza." 


AVA 40: 


"How about a large pepperoni pizza delivered by Domino's 
Pizza?" 


USERl: 


"Sounds great." 


Action: 


AVA 40 contacts Domino's Pizza, either through the web page, e- 
mail, facsimile, or direct voice communication. AVA then 
updates USERl *s profile. 



10 
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10 



AVA 40: 


Thank you Mr. Thompson. It was a pleasure to serve you. I'm 
AVA. Your Advanced Virtual Assistant for Concierge Services " 


Action: 

It is unde 


USERl goes on-hook. 

rStOOd that the information nrw^irWc ^™™U„,l „i r; 1 



as the scenarios associated therewith, are merely representative of many 
different applications. 
II. Selectable Grade of Service 

The AVA 40 also provides a selectable grade of service for connecting 
USERl to USER2 by enabling USERl to select a communication path 
therebetween. Examples of this are described below in Tables 7-9. 
Table 7: Selection of Grade of Service, part 1 



Action: 


USERl dials the AVA 40 and hears ringing. 


At Lion. 


40 answers the ringing line and speaks to USERl using a 
prerecoraea voice clip. 


AVA 40: 


Good afternoon. AVA here. Based on the number you're 
calling trom, 1 m assuming this is Larry. Is that right?" 


USERl: 


Yes. Please call David Mav" (In Fi& 7 T)nniH Mn^ /o rreppoi 


AVA 40: 


David May is likely to be at work right now. Would you like 
me to try his work number? I also have available his home 
number and his pager number." 


USERl: ~ 


"Let's try him at work." — — — — . 


AVA 40: 


Since this call is long distance, would you like to call him 
through the internet?" 


USERl: 


No. Let's make this a regular phone call." 


Action: 


AVA 40 contacts USER2's telephone 26 through switch 12, the \ 
PSTN 11a and switch 14. AVA then connects USERl to USER2, 
but stays bridged on the line. 


Action: 


USERl hears several rings. 


AVA 40: 


David May does not seem to be answering. Would you like to 
try his pager?" (ringing is heard in the background.) 


USERl: 


"O.K." 



15 
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AVA 40: 


"David Mays pager supports text messages. You may leave a 
short message. I will convert it to text for you. Say 
'FINISHED' when you are done. Speak now." 


USER1: 


"The meeting for four o'clock is canceled. Call me 111-555-1234. 
FINISHED." (The word "FINISHED" is a command word for 
AVA 40 that will not be converted to the text message.) 


AVA 40: 


"I will send the message. Would you like to call someone else?" 


USER1: 


"Yes. Please call John Doe." (In Fig. 1, John Doe is now 
USER2. 


AVA 40: 


"Since John Doe lives in London, it is eight o'clock p.m. right 
now and he is likely at home. Would you like me to try his 
home number?" 


USER1: 


"Yes. And connect through the internet." 


Action: 


AVA 40 contacts USER2's telephone 26 through the I-NET lib, 
VHP 66 and switch 14. AVA then connects USERl to USER2, 
but stays bridged on the line. Alternatively, USER2 may have 
his own AVA, and a communication path may be established 
from USERl to AVA 40 to the I-NET lib to USER2's AVA and 
then to USER2. 


Action: 


USERl and USER2 talk. USERl goes on-hook. 


Table 8: Selection of Grade of Service, part 2 


Action: 


USERl dials the AVA 40 and hears ringing. 


Action: 


AVA 40 answers the ringing line and speaks to USERl using a 
prerecorded voice clip. 


AVA 40: 


"Good afternoon." 


USER1: j 


"AVA"? 


AVA 40: 


"I'm here!" 


USER1: 


"Please call Brad Smith in his office on regular long distance". 


AVA 40: 


"Calling Brad Smith in his office on regular long distance". 
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Action: 


AVA 40 sends a Call Transfer /Bridge Command message to an 
internal switch of the VHP 42 for it to bridge a first trunk 
connected to USERl through the switch 12 with a second 
outbound long distance trunk to the PSTN 11a. AVA 40 always 
listening for next command 


Action: 


AVA 40 receives a Call Transfer 1 Bridge Acknowledgment 
message from the internal switch. 


Action: 


The PSTN provides a ring back tone and Brad Smith answers. 


1<luie v ' LJCiCl L1 " 11 "i ^raue or Service, part 3 ~ - 1 



USERl: 


"AVA"? " ' ' 1 


AVA 40: 


"I'm here!" 


USERl: 


Please call my sister m her office on low cost Voice-Over-IP" 


AVA 40: 


"Calling your sister in her office on low cost Voice-Over-IP' 


Action: 


AVA 40 sends a Call Transfer 1 Bridge Command message to an 
internal switch of the V/IP 42 for it to bridge a first trunk 
connected to USERl through the switch 12 with a data 
connection to the I-NET lib. The V/IP 42 also translates the 
voice from USERl to data packets to be transferred over the I- 
NET lib. AVA 40 is always conferenced in and listening for the 
next command 


Action: 


AVA 40 receives a Call Transfer 1 Bridge Acknowledgment 
message from the internal switch. 


Action: 

Although i 


The VHP 66, which may be part of an internet service provider 
of USER2, completes the connection to USER2 through the 
switch 14. The VHP 66 also translates the voice from USER2 to 
data packets to be transferred over the I-NET lib.. 

Llll]St.r»t.ive> omhnHimon+n ^-fj.U„ : — T~- — " — !— — r— 
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described, other modifications, changes, and substitutions are intended in the 
foregoing disclosure. For example, dual tone multi-frequency ("DTMP") as well 
as computer instructions may be additionally used to interface with the AVA 
40. Accordingly, it is appropriate that the appended claims be construed 
broadly and in a manner consistent with the scope of the invention. 
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WHAT IS CLAIMED IS: 



1 1. An integrated communications manager comprising: 

2 a voice-over internet protocol (V/IP) device for translating between voice 

3 and data; 
4 

5 an automatic speech recognition (ASR) device for converting voice to 

6 data; 
7 

8 a text-to-speech (TTS) device for converting data to voice; 

9 

10 a controller for controlling the operation of the V/IP, ASR, and TTS, and 

11 for receiving and transmitting the data; and 
12 

13 a storage device for storing the data for use by the controller; 

14 



15 wherein the integrated communications manager is connectible to a 

16 telephone network and to a data network connectible to at least one 

17 information provider; and 
18 

19 wherein the integrated communications manager provides an interface 

20 between a first user using a communication device connectible to the 

21 integrated communications manager and one of the at least one 

22 information provider. 

1 2. The integrated communications manager of claim 1 wherein the data 

2 network is also connectible to a communication device of a second user so 

3 that the integrated communications manager serves as an interface 

4 between the first user and the second user. 



The integrated communications manager of claim 2 wherein the 
telephone network is also connectible to a communications device of the 
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second user so that the first user may select either the telephone 
network or the data network for interacting with the second user. 



1 4. The integrated communications manager of claim 1 wherein the data 

2 network includes a local area network and the information provider is a 

3 computer. 

1 5. The integrated communications manager of claim 1 wherein the 

2 integrated communications manager interacts with the first user 

3 selectively using voice or data and communicates with the information 

4 provider using data. 



1 8. 

2 

3 



1 9. 
2 



The integrated communications manager of claim 5 wherein the 
communications device is a personal computer and wherein the data 
includes video clips to be displayed on the personal computer. 

The integrated communications manager of claim 1 wherein the 
integrated communications manager monitors communications between 
the first user and the information provider and stores data transmitted 
during the monitored communications. 

The integrated communications manager of claim 1 wherein the 
integrated communications manager monitors communications between 
the first user and the information provider for providing voice to be used 
during the communications. 

The integrated communications manager of claim 1 wherein the storage 
device also stores a user profile, a plurality of voice clips and a plurality 



3 of video clips 
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10. The integrated communications manager of claim 1 wherein the voice is 
comprised of analog voice signals and the data is comprised of digital 
data signals. 



11. An integrated communications manager including a voice-over internet 
protocol (V/IP) device, an automatic speech recognition (ASR) device, a 
text-to-speech (TTS) device, a controller, and a storage device, wherein 
the integrated communications manager is connectible to a first user 
through a first communication device, to a telephone network, and to a 
data network, wherein the telephone network is connectible to at least 
one service provider so that the integrated communications manager acts 
as an interface between the first user and the service provider, and 
wherein the integrated communications manager is capable of listening 
in on the communication between the first user and the service provider 
for providing data to be used during the communication. 

12. An integrated communications manager including a voice-over internet 
protocol (V/IP) device, an automatic speech recognition (ASR) device, a 
text-to-speech (TTS) device, a controller, and a storage device, wherein 
the integrated communications manager is connectible to a first user 
through a first communication device, to a telephone network, and to a 
data network, wherein both the data network and the telephone network 
are connectible to a second user so that the integrated communications 
manager acts as an interface between the first user and the second user 
and allows the first user to select between the data network and 
telephone network for connecting to the second user. 



13. 



A method of operating a media cross-translator connected to a first user 
and to a data network having at least one information provider, the 
method comprising the steps of: 



4 

5 

6 



11 



12 



4 



6 
7 

8 
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receiving a first portion of information in a first format from the first 
user; 

interpreting the first portion of information into a second format; 



7 providing the first portion of information in the second format to the 

8 information provider; 

receiving a second portion of information in the second format from the 
information provider; 



interpreting the second portion of information into the first format; and 



providing the second portion of information in the first format to the first 
13 user. 



1 14. The media cross-translator of claim 13 wherein the first format is voice 

2 and the second format is text. 

1 15. A method of operating an integrated communications service connected 

2 to a first user, a telephone network and to a data network having at 
least one information provider, wherein both the data network and the 
telephone network are connectible to a second user, the method 



5 comprising: 



receiving a first portion of information in a first format from the first 
user; 

interpreting the first portion of information into a second format; 



9 providing the first portion of information in the second format to the 

10 information provider; 
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11 

12 

13 

14 
15 

16 
17 
18 

1 16. 

2 

3 

1 17. 

2 

3 

1 18. 

2 

3 
4 

5 

6 

7 
8 



receiving a second portion of information in the second format from the 
information provider; 

interpreting the second portion of information into the first format; 

providing the second portion of information in the first format to the first 
user; and 

in response to a command from the first user, selecting between the data 
network and telephone network, connecting the first user to the second 
user using the selected network. 

The method of claim 15 further comprising monitoring the connection 
between the first user and the second user for storing a third portion of 
information transferred therebetween. 

The method of claim 15 further comprising monitoring the connection 
between the first user and the second user for providing a third portion 
of information. 

A method of operating an electronic communications manager comprising 
steps of: 

translating back and forth between voice, internet protocol data and 
computer data; 

connecting to a first user; 

connecting to a data network having at least one information provider; 

connecting to a telephone network, wherein both the data network and 
the telephone network are connectible to a second user; and 
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in response to a voice command from the first user selecting between the 
data network and telephone network, connecting the first user to the 



11 second user using the selected network. 

1 19. An electronic communications manager comprising: 

2 means for translating back and forth between voice, internet protocol 

3 data and computer data; 



means for connecting to a first user; 



5 means for connecting to a data network having at least one information 

6 provider; 



means for connecting to a telephone network, wherein both the data 
network and the telephone network are connective to a second user; and 

means responsive to a voice command from the first user selecting 
between the data network and telephone network for connecting the first 
user to the second user using the selected network. 
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(57) Abstract 

An electronic communications manager (40) for providing an interface between a user (16, 18, 20, 22, 24) using a communication 
device and a data (1 ib) and/or telephone network (11a). The data network (lib), which may include an internet or intranet, is connectible to 
at least one information provider (60, 62, 64) as well as a second user (26, 28), and the telephone network (1 la) is also connected to the 
second user (26, 28). The electronic communications manager (40) can receive and interpret voice, such as from the first user using a 
telephone (16, 18), as well as data, such as from the first user using a computer (22, 24) or information appliance (20). Likewise, the 
electronic communications manager (40) can provide voice/video, such as for interacting with the first user through the telephone (16 18) 
and can provide data, such as interacting with the first user through the pager (20) or interacting with the second user (26, 28) through the 
data network (lib). Furthermore, the electronic communications manager (40) can send and receive internet protocol (66) to and from the 
information provider (60, 62, 64). 
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